Lightweight distributed computing framework for orchestrating high performance computing and big data

In recent years, the need for ability to work remotely and subsequently availability of remote computer-based systems has increased substantially. This trend seen a dramatic increase with onset 2020 pandemic. Often local data is produced, stored, processed in cloud remedy this flood computation storage needs. Historically, HPC (high performance computing) concept big have been utilized processing large data. However, both Hadoop can be as solutions analytical work, though differences between these may not obvious. Both use parallel techniques offer options stored either centralized or distributed manner. Recent studies focused on using hybrid approach technologies. Therefore, convergence technologies filled computing machines at layer described. paper results from motivation that there exists necessity framework scale SOC (system chip) boards desktop computers servers. For purpose, article, we propose environment up devices heterogeneous architecture, where set clusters resource-limited nodes then run top of. The solution thought minimalist Within scope study, only design proposed system detailed, but also critical modules subsystems are implemented proof concept.